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ABSTRACT 

The  first  section  of  this  paper  is  concerned  with  determining  the 
required  lower  confidence  limit  that  must  be  met  by  testing  after  a 
missile  system  becomes  operational.      Some  of  the  costs  of  making 
decisions  about  the  required  system  reliability  lower  confidence  limit 
are  discussed.      Two  possible  cost  effective  models  for  determining 
the  optimum  test  size  are  suggested. 

The  second  section  of  thi's  paper  is  concerned  with  the  effects  of 
changing  the  number  of  missiles  tested  in  each  year  while  maintaining 
the  total  number  of  systems  tests  constant  over  the  missile  system's 
projected  operating  life.      In  other  words,    in  this  section,    the  effects 
of  testing  heavily  in  the  first  years  versus  testing  heavily  at  the  end 
of  the  system's  life  or  versus  testing  uniformly  throughout  the  life  of 
the  system  are  compared.      For  this  comparison,    the  sum  of  the  vari- 
ances of  the  estimators  determined  from  the  results  of  the  tests  con- 
ducted in  each  year  is  obtained.      This  value  is  compared  for  six 
representative  distributions  of  testing  throughout  an  estimated  system 
life  of  ten  years. 
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1.       INTRODUCTION 

There  are  three  types  of  tests  for  our  current  Polaris  missile 
system: 

1.  The  Demonstration  and  Shakedown  Operation  -  DASO, 

2.  Operational   Tests    -   OT; 

3.  Follow-on  Operational  Test  -  FOT. 

DASO  represents  the  first  test  of  the  weapon  system  in  its  totality. 
For  this  test,    the  missiles  are  carefully  prepared  and  then  fired  under 
strigent  conditions.      The  results  of  DASO  firings  are  not  included  in  the 
data  for  determining  the  weapon  system  reliability. 

The  OT  program  is  a  one-time  test  program  with  the  specific  ob- 
jective of  determining  weapon  system  reliability.      It  is  conducted  under 
the  most  realistic  conditions  possible.      The  system  is  tested  in  such  a 
way  that  the  entire  operational  system,    including  communications, 
authentication,    navigation,    and  accuracy,    is  tested;  and  the  observed 
success  rate  is  computed. 

The  FOT  is  conducted  in  the  same  manner  as  the  OT  with  the 
specific  objective  of  insuring  that  the  weapon  system  reliability  factor 
determined  in  the  OT  program  is,    in  fact,    still  valid  in  the  years 
following  the  Operational  Tests. 


This  paper  is  concerned  with  determining  the  optimal  OT  and  FOT 
test  sample  sizes.      Much  of  the  work  presented  here  was   started  this 
summer  at  the  Office  of  Programs  Appraisal  under  the  direction  of 
Captain  D.    A.    Paolucci.      In  addition,    some  of  the  ideas  introduced 
come  from  unpublished  notes  of  Captain  Paolucci. 


2.       SUMMARY  AND  CONCLUSIONS 

2.  1    A  Model  for  Maximizing  the  Number  of  Reliable  Missiles  in 
Inventory 

In  the  final  analysis,    the  number  of  missiles  from  a  system  counted 
on  by  the  strategic  planner  will  be  determined  by  the  number  of  missiles 
available  and  the  90  percent  lower  confidence  limit     for   system 
reliability.      In  other  words,    if  the  90  percent  lower  confidence  limit  of 
reliability  is  .  7  and  there  are  N  missiles  available,    the  strategic 
planner  will  count  on  .  7N  when  targeting  the   system. 

Assuming  that  the  observed  success  rate  is  relatively  constant, 
the  lower  confidence  limit  of  reliability  will  increase  every  time  a 
missile  is  successfully  tested.      By  observing  Figure  2.  1.  1,    it  can  be 
seen  that  the  marginal  return  for  each  test  reaches  a  near  zero  point 
when  the  lower  confidence  limit  comes  within  .11  to  .  09  of  the  observed 
success  rate.      This  observation  might  lead  to  the  criterion  that  testing 
should  continue  until  the  lower  confidence  limit  of  reliability  is  within 
.11   to  .  09  of  the  observed  success  rate. 

It  can  be  shown,    see  section  3.  1,    that  using  this   criterion  for 
determining  test  sizes  can,    under  certain  circumstances,    result  in  a 

To  avoid  messy  notation  and  confusing  the  problem,    this 
paper  will  always  use  the  90  percent  confidence  level.      This  choice  of 
90  percent  is  completely  arbitrary  and  may  not  necessarily  reflect 
Navy  policy. 
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FIGURE  2.  1.  1 


smaller  number  of  reliable  missiles  counted  on  by  the  targeter  than 

would  be  counted  on  if  fewer  missiles  were  tested. 

For  this  reason,    the  following  alternate  model  for  determining  the 

required  test  size  to  estimate  missile  system  reliability  is  suggested. 

Choose  n  to  maximize  Q  in  the  following  expression. 

Q    =     L(M  -  n)  ,     where: 

L    =    the  90  percent  lower  confidence  limit  determined 
by  n  and  the  observed  success  rate; 

M    =    the  total  number  of  missiles  purchased; 

n     =    the  number  of  trials. 

Using  this  criterion  to  determine  the  test  size  results  in  testing 
about  33  missiles  if  the  observed  success  rate  is  in  the  area  of  .  7  to 
.9.        The  criterion  mentioned  earlier  requires  approximately  35,    46, 
and  49  missiles  for  observed  success  rates  of  .  9,    .8,    .  7,    respectively. 

A  cost  effective  model  for  determining  the  test  size  to  most 
effectively  increase  the  reliable  yield  of  the  expected  number  of  missiles 
deployed  is  presented  in  section  3.  2.      This  model  uses  the  marginal 
cost  of  increasing  the  expected  yield  of  the  Polaris  missile  system  by 
procurement  as  the  cut-off  point  for  spending  on  missile  testing. 

The  cost  information  necessary  to  obtain  an  explicit  number  for 
test  size  using  this  model  is  not  known  to  the  author.      Therefore,    no 


See  section  3.  1  for  mathematical  justification  of  this 
statement. 


further  discussion  of  this  model  will  be  presented  in  this   section  except 
to  note  that  the  figures  necessary  to  obtain  an  explicit  solution  are 
obtainable. 
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2.  2    Brief  of  Method  Used  in  Investigating  Models  One,    Two,    and  Three 

The  present  doctrine  used  to  determine  FOT  test  sizes  is  to  use 
the  same  size  test  that  is  necessary  for  the  OT.      Therefore,    for  the 
next  ten  years  somewhere  between  300  and  400  missiles  would  be 
programmed  for  expenditure  during  OT's  and  FOT's. 

To  investigate  some  of  the  effects  on  reliability  estimation  by 
changing  the  yearly  FOT  test  size,    six  different  sample  plans  that 
distribute  the  testing  throughout  the  years  in  different  ways  were  con- 
sidered.     These  sample  plans  are  given  in  Table  2.  2.  1. 

To  avoid  confusion  in  this  section,    all  testing  done  in  year  i  will 
be  designated  as  test  i;    and  the  individual  shots  will  be  designated  as 
trials.      Each  different  way  of  distributing  the  tests  among  the  years 
will  be  called  a  sample  plan. 

To  compare  the  different  sample  plans,    the  sum  of  the  variances 
computed  in  each  year  will  be  obtained  for  each  sample  plan.      In  other 
words,    the  variance  of  the  estimator  of  reliability  will  be  obtained 
under  a  sample  plan  for  year  one.      Then,    using  the  same  sample  plan, 
the  variance  of  the  reliability  estimator  will  be  obtained  for  years 
two  through  ten.      Once  these  values  have  been  obtained,    the  ten  of  them 
will  be  added  together  and  the  sum  will  be  called  the  sum  of  the 
variances. 

The  reason  for  the  criterion  of  comparing  the  sum  of  the  variances 
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can  be  likened  to  the  quest  for  a  "minimum  variance  estimator"  in 
many  conventional  estimation  problems. 

The   sum  of  the  variances  depends  on  the  different  test   sizes,    the 
initial  reliability  (p„),    and  the  total  number  of  missiles  tested  in  the 
ten  years.      An  attempt  has  been  made  to  investigate  the  different  sample 
plans  over  a  plausible  range  of  values  for  p     and  N,    the  number  of 
missiles   scheduled  for  testing  during  the  first  ten  years  of  operational 
life.      To  this  end,    the  sum  of  the  variances  for  each  sample  plan  is 
computed  using  all  possible  combinations  of  .  7,    .8,    .9   for  p    ,    and  200, 
300,    and  400  for  N. 

Perhaps  a  little  more  explanation  is  merited  here.      Assume  that  the 
sum  of  the  variances  of  sample  plan  one  is  being  computed.      Now  look 
at  the  situation  where  p     =  .  7  and  N  =  200.      When  N  =  200,    sample 
plan  one  requires  that  20  trials  of  the  system  be  conducted  in  the  first 
year.      From  this,    an  expression  for  the  variance  of  the  estimator  can 
be  obtained.      Likewise,    an  expression  for  the  variance  of  the  estimator 
in  years  two  through  ten  can  be  obtained.      Once  the  variances  for  all 
the  years  have  been  obtained,    they  are  added  together  and  the  number 
is  recorded  as  the   sum  of  the  variances  under  sample  plan  one,    where 
p     =  .  7  and  N  =  200.      Next,    sample  plan  two  will  be  used;  and  the 
sum  of  the  variances  under  this   sample  plan,    when  p     =  .  7  and  N  -  200, 
will  be  obtained. 
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We  will  continue  in  this  fashion  until  the  sum  of  the  variances 
when  p     =  .  7  and  N  -  200  have  been  determined  for   sample  plans  one 
through  six.      Then,    the  next  combination  of  p     and  N,    say  p      -  .  7, 
N  =   300,    will  be  considered.      In  the  same  manner  as  before,    the  sum 
of  the  variances  for  all  the  sample  plans  will  be  obtained.      The  compu- 
tations will  continue  until  the  sum  of  the  variances  for  each  sample 
plan  has  been  obtained  for  all  possible  combinations  of  the  three  values 
of  p     and  N.      Having  obtained  these  variances,    those  sampling  plans 
with  the  associated  smaller  variance  values  would  be  superior  to  those 
with  larger  variances  from  the  point  of  view  of  having  accurate  esti- 
mates of  missile  reliability. 
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2.  3    Determining  FOT  Sample  Size  Using  Model  One 

Consider  a  collection  of  N  missiles  that  are  characterized  by  life- 
times   X     ,    X^  ,   ...    ,  X       where  X     represents  the  time  from  initial 
12  N  l       r 

inspection  and  release  until  the  i       item  deteriorates  to  an  unacceptable 
state.      If  it  is  assumed  that  the  initial  states  of  the  missiles  are  the 
same,    then  the  X.'s  are  non-negative  independent,    identically  distributed 
random  variables.      Suppose  that  there  are  ten  distinct  times  that  ob- 
servations are  to  be  taken  from  the  collection  of  missiles.      Also,    assume 

that  K.   items  are  to  be  observed  at  time   t.  .      These  observations  can  be 
i  i 

summarized  by  the  random  variables    Y    ,   Y     ,    .  .  .    ,  Y  where: 

12  K. 

i 

r  1       if  the  missile  system  fails 

0      if  the  missile  system  is   successful 

On  the  basis  of  this  information,    it  is  desired  to  estimate    R(t.  )  , 
P   (a  missile's  lifetime  is  greater  than  t.  )  ,     for  each   t.     =    j  , 
j     =     1,    2,    ...    ,10.      The  estimation  procedure  which  is  proposed  has 
the  following  form.      For  each  j  ,     the  estimate  of  R(t.  )  is  given  by 

n  (N  -  n  -     i  Y 

l-l                '"'            K=(null) 
R(t.)    =         

J  N(N-n    )  (N-n, )..  .  (N-n.        ) 

1  2  j  -  1 
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w  here: 


=    o , 

11 . 

=    L    K    , 

n. 

u 

1 

i=l      r 

1 

1,    2,  .  .  .  ,    10 


K       =    no.    of  trials  in  year  r 
r 

c    1     if  test  i  fails 
Y.      =    | 

0     if  trial  i  is  successful 

This  estimator  provides  continuity  to  the  estimates  of  reliability 
over  the  ten  years,    see  section  3.  3.     However,    this  estimate  is 
generally  more  optimistic  in  the  early  years  and  more  pessimistic  in 
the  out  years  than  the  Maximum  Likelihood  Estimator.      The  MLE 
mentioned  here  is  the  MLE  of  reliability  using  only  the  information 
obtained  from  the  current  test.      Note  that  Model  One  does  take  past 
data  into  account. 

To  investigate  Model  One,  it  was  assumed  that  the  probability  of 
a  successful  trial  at  any  given  time  t  could  be  expressed  by  the  expo- 
nential function: 

P(t)     =    p    e  where    b    is  an  unknown  parameter. 

The  sum  of  the  variances  was  then  computed  for  all  combinations  of 
p     and  N,     as  explained  before.      In  addition,    these  values  were  computed 
for  values  of  b    ranging  from  .  002  to  .  2.      The  results  of  these  compu- 
tations are  displayed  in  the  graphs  on  pages  20  through  37. 

On  these  graphs,  values  of  b  are  plotted  along  the  abscissa,  and 
values  of  the  sum  of  the  variances  are  plotted  along  the  ordinate. 
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The  grid  superimposed  on  each  graph  is  a  one-inch  square  grid.      The 
scale  of  the  abscissa,    x  scale,    the  scale  of  the  ordinate,    Y-SCALE, 
the  initial  reliability,    P(0),    and  the  total  number  of  trials  in  ten 
years,    N,    are  lettered  at  the  bottom  of  each  graph.      These  values  are 
written  in  powers  of  ten.      The  number  directly  next  to  the  letter  E  is 
the  power  of  ten  by  which  the  main  number  is  to  be  multiplied.      For 
example,    the  number   5.  00E-01   is  read  as   5.  0  x  10         or  .  5.      The 
number  2.  00E+02  is  read  as  2.  0  x  10     or  200.      The  numbers  just  to 
the  right  of  each  plot  designates  the  sample  plan  that  was  used  to  obtain 
the  plot.      Suppose  the  sum  of  the  variances  for   sample  plan  one  is 
desired  when  p     =  .  7,    N  =  200,    and  b  =  .  1.      The  graph  for  this  case  is 
found  on  page    20.      The  value  desired  can  be  read  off  the  curve  labeled  1. 
Similarly,    the  sum  of  the  variances  for  sample  plan  six  with  the  same 
parameters  can  be  read  from  the  curve  labeled  6.      To  insure  that  the 
reader  has  found  the  proper  values,    these  values  have  been  marked 
with  an  x.      The  graphs  are  filed  in  the  following  order:     all  combinations 
of  N  with  p     =  .  7,    then  all  combinations  of  N  with  p      =  .  8,    and  then 
all  values  of  N  with  p     =  .  9. 

From  reading  these  graphs,    it  can  be  seen  that  for  all  values  of 
the  parameters   sample  plan  six  and  four  have  the  smallest  sum  of  the 
variances.      The  rest  of  the  sample  plans  range  from  next  smallest  to 
largest  value  of  the  sum  of  the  variances  in  the  following  order: 


three,    one,    two,    five.      For  ease  in  understanding  the  results,    the  table 
explaining  the  yearly  test  sizes  for  each  sample  plan  is  reproduced  on 
the  following  page. 

These  results  indicate  that  if  200  missiles  were  programmed  for 
Follow  on  Testing  in  the  next  ten  years  there  may  be  some  merit  to 
distributing  the  testing  as  shown  below. 

Suggested  allocation  per  year  of  FOT  testing 
if  a  total  of  200  trials  are  to  be  conducted: 

Year  one     --     60  trials; 

Years  two  through  six     --     20  trials; 

Years  seven  through  ten     --     10  trials. 

These  figures  are  obtained  using  sample  plan  four. 
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2.4    Determining  FOT  Test  Sizes  Using  Model  Two 

Model  two  uses  the  following  expression  for  reliability  at  any 
time  t: 

R(t)     =    p      -    BeCt        t  >  0 
where: 

p     =      initial  reliability; 

B     =     a  known  constant; 

c     =     an  unknown  parameter. 
Notice  that  this  expression  assumes  an  exponential  decay  of  reliability 
as  time  increases.      The  factor  B  is  chosen  so  that  R(t)  is  always  non- 
negative.      The  graph  of  e     for  positive  x  starts  at  a  value  of  one  and 
is  monotonically  increasing  as  x  increases,    see  figure   2.  4.  2. 
If  a  scaling  factor  was  not  used  in  the  expression  for  reliability,    then 
negative  values  would  be  obtained.      Arbitrarily,    a  scaling  factor  of 
B  =  .  01  was  used.      This  merely  displaces  the  curve  of  the  second  term 
in  the  expression  downward,    see  figure    2.  4.  2. 

To  investigate  Model  Two,    a  Maximum  Likelihood  Estimator  for 
reliability  was  obtained.      Then,    the  expression  for  the  variance  of  this 
estimator  was  determined,    see  section  3.  4.      The  sum  of  the  variances 
was  then  computed  for  all  combinations  of  p     and  N,    as  explained  in 
section  2.  2.      In  addition,    these  values  of  the  sum  of  the  variances  were 
computed  for  values  of  c  ranging  from  .  00424  to  .  424.      Note  that  if 


larger  values  of  c  were  allowed,    R(t)  would  be  negative  when  t  =   10. 
Therefore,    c  has  been  varied  over  its  entire  range  of  plausible  values. 

The  results  of  the  computations  of  the  sum  of  the  variances  are 
displayed  on  the  graphs  on  pages  42  through  59.      The  abscissa  of  these 
graphs  represents  values  of  c.      The  ordinate  of  these  graphs  represents 
values  of  the  sum  of  the  variances.      See  page  17  for  an  explanation  of 
how  to  read  these  graphs. 

By  examining  these  graphs,    it  can  be  seen  that  the  sample  plan 
that  gives  the  minimum  sum  of  the  variances  for  all  combinations  of 
p     and  N  is  sample  plan  six.      The  value  of  the  sum  of  the  variances 
then  increases  for  the  sample  plans  in  the  following  order:     plan  four, 
plan  three,    plan  one,    plan  five,    and  then  plan  two. 

For  convenience  in  understanding  these  results,    the  table  explaining 
the  yearly  test  sizes  for  each  sample  plan  is  reproduced  on  the  following 
page.      Notice  that  as  in  the  first  model  the  sum  of  the  variances  is  less 
for  the  plans  that  call  for  heavy  testing  in  the  early  years.      The  plans 
that  call  for  heavy  testing  in  the  out  years  result  in  the  largest  values 
of  the  sum  of  the  variances. 


39 


2 

2  cM 

— I  O 


2 

r\i 

C 

o 

0 

y 

z 

en 

ft 

o 

X 

c 

<4H 

0 

CO 

CO 

E 

O 

rt 

D 

y 

v 

0 

2 

fO 

>- 

tf 

'H 

o 

X 

H 

CO 

H 

Jh 

2 

2 

y 

o 

i— i 

—< 

CD 

CO 

J~ 

2 

c 

< 

V 

dn 

2 

CO 

y 

u 

w 

7) 

a- 

4-J 

CO 

s 

y 

CO 

CO 

O 

<-< 

CO 

g 

a 

uO 

<+H 

y\ 

2 

o 

< 

LPl 

y 

1) 

& 

o 

"^ 

-Q 

H 

^ 
J 

2 

in 

o 

tf 

y 

N 

3 

0 

• 

+•> 

:* 

<U 

o 

ft 

2 

a 

oi 

oo 

s 

40 


V 


GRAPH  OF   e      VERSUS  x 
FIGURE  2.  4.  2 


41 


I 

Eb 

<: 

, 

— — 

iO) 

* 

p 

P~     ^~*^ — ^ 

fcj 

? 

^^^^r^-- -^ 

-     H. 

I 

"^*\ 

8 

V 

r 

V 

& 

. 

._~ 

... 

822 

803 

88H 

<.Z5 

80S  , 

X-SCALE 
Y-SCALE 


5.  OOE 
5.00E 


01 

02 


Units/  Inch. 
Units /Inch. 


P(0)     =     7.  OOE   -  01 
N  =     2.  OOE  +  02 


SUM  OF  VARIANCES  VERSUS  c 
42 


•v*  W* 


• 

1 

r 

8 

i 

3 

i 

i 

f~ 

2 

■ 

ca 

\ 

1 

: 

ca 

04 

. 

? 

-, 

C" 

C 

, 

088                   SQi                   682 

^3 

Cw- 

o^J 

G33 

X-SCALE    =     1.00E-01       Units/Inch. 
Y-SCALE    =     1.00E-01       Units/Inch. 


P(0)    =    7.00E  -  01 
N  =2.  00E  4-  02 


SUM  OF  VARIANCES  VERSUS  c 
43 


to 

— — .    i 

»-« 

*t 

<s> 

— 

--^     3 

CM 

cs 

s 

— ^ 

-^     «i 

^*v 

X     6 

1 

g 

c* 

1 

. 

i 

aoe 

901 

902 

903 

m 

905 

m 

X-SCALE     =     1.00E 
Y-SCALE    =     2.  00E 


01     Units/Inch.                                     P(0) 

=    8.  00E  -  01 

02     Units /Inch.                                    N 

=    2.  00E  +  02 

SUM  OF  VARIANCES  VERSUS    c 

44 

- 

w 

8 
8 

8 

ss 
s 

1 

• 

(  -, 

f                i 

i 

1 

- 

I 

609 

£31 

882 

683 

2m 

60S 

ess 

X-SCALE    = 
Y-SCALE    = 


1.  OOE  -  01 
5.00E  -  02 


Units /Inch. 
Units/Inch. 


P(0)     = 

N 


8.  OOE  -  01 
2.  OOE  +  02 


SUM  OF  VARIANCES  VERSUS  c 
45 


1 

-~~~" 

., 

r\ 

v~ 

— -.      3 

•»* — ■  ' 

ca 

— ==— — * 

— : — *" 

^    6* 

■ 

^^5" 

w 

==^ 

^~*~^"^ 

! 

v.. 

(N 

C5 

~ 

c 

y 

Q8a 

501 

082 

WwJ 

88*4 

a^o 

686 

X-SCALE 
Y-SCALE 


1.  00E  -  01 
1.  00E  -  02 


Units /Inch. 
Units /Inch. 


P(0) 

N 


9. 00E   -  01 
2.  00E  +  02 


SUM  OF  VARIANCES  VERSUS   c 
46 


< 

<s 

i 

2 

i 

.      5 

a* 

»-. 

a 

j 

«-. 

[ 

v_ 

( 

'. 

»-. 

c, 

■ 

^_ 

o 

1 

^_ 

r- 

^_ 

<>■ 

8 

i 

, 

! 

»                  £31                  0^2 

ooCi 

63* 

c-~? 

ess. 

X-SCALE 
Y-SCALE 


1.00E  -  01 
2.00E  -  02 


Units /Inch. 
Units/ Inch. 


P(0) 

N 


9. 00E  -  01 
2.  00E  +  02 


SUM  OF  VARIANCES  VERSUS  c 

47 


r? 

■ 

o 

Q 

v. 

-- 

CSJ 

<.- 

1 

1 

U> 

O 

\ 

—      3 

i        " 

cs 

s           - 

=^r^~-— ~ 

-      t-. 

.— . 

; 

"    -*>^ 

.      6 

- 

V 

032 

003 

o<& 

^^0 

886 

X-SCALE    = 
Y-SCALE    = 

1.  OOE 

5.  OOE 

-  01       Units/Inch.                                     P(0) 

-  02      Units/Inch.                                     N 

SUM  OF  VARIANCES  VERSUS  c 
48 

=     7.  OOE  -  01 
=     3.  OOE  +  02 

1 

' 

• 

i 

i 

=  1 

!  ■ 

1 

1 

Q 

, 

v- 

' 

ca 

i 

u 

i  : 

s    . 

u 

s 

c 

ca 

V', 

QQ8 

C_rl 

^j 

£33 

Zw-_ 

vwO 

683 

X-SCALE    =     l.OOE-Ol      Units/Inch. 
Y-SCALE    =     5.00E-02      Units/Inch. 


P(O) 
N 


7.  OOE  -  01 
3.00E  +  02 


SUM  OF  VARIANCES  VERSUS  c 
49 


X-SCALE    = 
Y-SCALE    = 

=     l.OOE 
=     2.00E 

-01       Units/Inch.                                     P(0)     =     8.00E-01 
-02      Units/Inch.                                     N           =     3.  00E  +  02 

SUM  OF  VARIANCES  VERSUS  c 

50 

\\ 

" 

c 

u 

. 

! 

CU 

U 

i\ 

: 

& 

c 

10 

- 

t£ 

'  © 

Q 

■ 

« 

c 

• 

cs 

V_^w 

C^U 

682 

c, 

Q^-i 

6o5 

eQ6j 

X-SCALE    =     1.00E  -  01 
Y-SCALE    =     5.00E  -  02 


Units /Inch. 
Units /Inch. 


P(0)     =    8.  OOE  -  01 
N  =    3.  OOE  +  02 


SUM  OF  VARIANCES  VERSUS  c 

51 


1 



1 

V- 

< 

■ 

-"       "" 

_— ^ 

^^        >-.  ~ 

1 

v_ 

1 

csi 

^  -  - 

081 

502 

w^O 

..J 

X-SCALE    = 

l.OOE  -  01       Units/Inch.                           P(0) 

=    9.  OOE  -  01 

Y-SCALE    = 

1.  OOE  -  02      Units/Inch.                           N 

SUM  OF  VARIANCES  VERSUS    c 
52 

=     3.  OOE  +  02 

tft 

«— 

ca 

- 

v 

&j 

c 

o 

'       5 

c 

-__^_^=^~ — ~~^=:::~:::~'       """" 

' 

13 

. 

c 

- 

! 

u_ 

■ 

( 

ca 

l 

1         1         1 

i 

t; 

•                  >                  i.      — 

GQ3 

X-SCALE 
Y-SCALE 


•w-jj 


ww 


W- 


cZ5 


ess 


1.00E  -  01       Units/Inch. 
2.00E  -  02      Units/Inch. 


P(0)     =    9.00E  -  01 
N  =3.  00E  +  02 


SUM  OF  VARIANCES  VERSUS  c 
53 


§3 


■  i 

— .   1 

' 

^—-^^ 

^  3 

""""-^ — ->^^^ 

"-   Li 

=== 

.   6 

eoa 

QOl 

682 

B03 

ww_ 

006 

3v3 

X-SCALE    =     1.00E-01       Units/Inch. 
Y-SCALE    =     2.00E-02      Units/Inch. 


P(0)     =    7.  00E   -  01 
N  =4. 00E  +  02 


SUM  OF  VARIANCES  VERSUS  c 
54 


w 

8 

1            | 

i 

J 

! 

•-■ 

.-. 

i 

yfiQ 

63i 

232 

6S3 

0#i 

6^5 

633 

X-SCALE 
Y-SCALE 


1.  OOE  -  01 
5.  OOE  -  02 


Units/ Inch. 
Units/Inch. 


P(0)     =     7.  OOE  -  01 
N  =  ->,00E  +  02 


SUM  OF  VARIANCES  VERSUS  c 

55 


ooo 


061 


882 


883 


m 


886 


886 


X-SCALE    =     1.00E 
Y-SCALE    =     1.00E 


01 

02 


Units /Inch. 
Units/Inch. 


P(0)     =     8.  00E   -  01 
N  =4.  00E  +  02 


SUM  OF  VARIANCES  VERSUS    c 


— .     5 


OG0  001  802  G03 

X-SCALE    =     1.00E-01      Units/Inch. 
Y -SCALE    =     2.  00E-02      Units/Inch. 


<m 


P(0) 

N 


»  006 

8.00E  -  01 

4.  00E  +  02 


SUM  OF  VARIANCES  VERSUS 
57 


f 

a 

.     3 

^^— *— 

" " 

— ■* 

v    _ — — 



^ 

rz^^ 

^r- 

u 

! 

— 

^2~^*~^ 

; 

^^^^^^"^^^ 

« 

!..-; 

v 

V 

<S 

fai 

fe 

338 

Swl 

3Q2 

883 

... 

385 

&3S 

X-SCALE    =     1.  OOE  -  01 
Y-SCALE    =     5.  OOE  -  03 


Units/ Inch. 
Units /Inch. 


P(0) 

N 


4.  OOE  +  02 


SUM  OF  VARIANCES  VERSUS  c 
58 


i 


QQ0  B31  v-^_  ©33  v-^/_  Ovj 

X-SCALE    =     1.00E-01       Units/Inch. 
Y-SCALE    =     1.00E-02      Units/Inch. 

SUM  OF  VARIANCES  VERSUS  c 

59 


e^o 


P(0)     =    9.  00E  - 

N  =4.  00E  + 


01 
02 


2.  5    Determining  FOT  Sample  Size  Using  Model  Three 

Model  Three  uses  the  following  model  for  reliability  at  any  time  t: 


R(t)    =    pQ    -    at 


where: 


p     =  the  initial  reliability; 

a     =  an  unknown  parameter. 
This  linear  model  was  chosen  so  that  the  more  complex  models  one  and 
two  might  be  compared  with  a  simple  and  familiar  model. 

To  investigate  this  model,    a  maximum  likelihood  estimator  for 
reliability  was  obtained.      Next,    an  expression  for  the  variance  of  this 
estimator  was  determined,    see  section  3.  5.      Using  the  method  outlined 
in  section  2.  2,    the  sum  of  the  variances  was  then  computed  as  a  function 
of  a  for  all  combinations  of  p     and  N.      The  values  of  the  sum  of  the 
variances  were  then  determined  for  a  range  of  values  of  a  between  0 
and  p/ 10.      At  this  point,    R(10)  becomes  negative;  therefore,    the 
sum  of  the  variances  has  been  computed  for  the  entire  range  of  plausible 
values  of  a. 

The  results  of  the  computations  of  the  sum  of  the  variances  are 
displayed  on  the  graphs  on  pages   63  through  80.      The  abscissa  of  the 
graph  represents  values  of  a  and  the  ordinate  represents  values  of  the 
sum  of  the  variances.      See  page   17  for  an  explanation  of  how  to  read 
these  graphs. 
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By  examining  these  graphs,    it  can  be  seen  that  the  sample  plan 
that  gives  the  minimum  sum  of  the  variances  for  all  combinations  of 
p    ,    N,    and  values  of  a  is  sample  plan  six.      The  value  of  the  sum  of  the 
variances  increases  for  each  sample  plan  in  the  following  order: 
plan  four,   plan  three,   plan  one,    plan  five,    and  then  plan  two. 

For  convenience,    a  table  explaining  the  size  of  each  yearly  test 
under  the  different  sample  plans  is  presented  on  the  following  page. 
Notice  that  as  in  the  first  two  models  the  minimum  sum  of  the  variances 
occurs  for  the  plans  that  test  heavily  in  the  early  years  and  moderately 
in  the  out  years.      The  plans  that  call  for  heavy  testing  in  the  out  years 
have  the  largest  values  of  the  sum  of  the  variances. 
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2.  6    Comparison  of  Models  One,    Two,    and  Three 

The  sum  of  the  variances  for  all  three  models  was  minimum  for 
sample  plan  six.      Sample  plan  six  calls  for  extremely  heavy  testing  in 
the  early  years  and  very  little  testing  in  the  out  years.     Sample  plan 
four  results  in  values  of  the  sum  of  the  variances  that  are  next 
smallest  to  the  values  for  plan  six.      However,    plan  four  is  very 
similar  to  plan  six.      Note  that  plan  three  also  calls  for  heavy  testing 
in  the  early  years  and  moderate  testing  in  the  out  years.      Sample  plan 
three  is  different  from  plans  four  and  six  in  that  the  testing  in  the 
early  years,    although  heavy,    is  more  moderate  than  that  called  for 
in  the  early  years  by  plan  six  or  four.      The  testing  required  in  the  out 
years  by  plans  four  and  three  is  moderate.      However,    the  scheduled 
testing  is  not  as  moderate  as  for  sample  plan  six.      For  all  cases,    i.  e.  , 
all  models  and  values  of  the  unknown  parameters,    the  sample  plans  that 
call  for  moderate  testing  in  the  early  years  and  heavy  testing  in  the  out 
years  (plans  two  and  five)  result  in  values  of  the  sum  of  the  variances 
that  are  a  maximum. 

Testing  heavily  in  the  early  years  rather  than  testing  uniformly 
throughout  the  years  or  testing  heavily  in  the  out  years  has  some 
appeal  to  the  practical.     Since  missile  systems  are  programmed  for 
an  operational  life  of  about  ten  years,    planners  might  be  reluctant  to 
launch  any  large  correction  program  determined  necessary  by  testing 
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in  the  out  years.      Rather  than  spending  money  on  a  retiring  system 
the  planners  might  prefer  to  spend  the  money  speeding  up  the  phase 
in  of  the  successor  system.     However,    efforts  along  this  line  are 
usually  not  successful  and  in  all  likelihood  an  unsuspected  discrepancy 
in  a  missile  system  that  shows  up  in  the  out  years  will  not  be 
corrected. 

Heavy  testing  conducted  in  the  early  years  will  allow  for  much 
higher  confidence  in  the  predictions  of  reliability  for  the  out  years. 
From  these  predictions,    a  potential  discrepancy  in  the  system  that 
might  not  be  noticed  until  the  out  years  under  other  sample  plans  may 
be  uncovered  early  in  the  system's  life.      Because  of  this,    corrective 
action  can  be  taken  while  time  is  available  and  planners  are  more 
willing  to  invest  in  the  system. 


8  2 


.8 


.6 


.  5 


.  3 


.2 


.  1 


10 


20 


30 


40 


50 


60 


90  PERCENT  LOWER  CONFIDENCE  LIMIT 
VERSUS  SIZE  OF  TEST  (n) 

FIGURE  3.  1.  1 
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3.       ANALYSIS  AND  DISCUSSION 

3.  1    Mathematical  Support  of  the  Inventory  Model 

In  the  final  analysis,    the  number  of  missiles  from  a  system  counted 
on  by  the  strategic  planner  will  be  determined  by  the  number  of  missiles 
available  and  the  90  percent  lower  confidence  limit  for  system 
reliability.      In  other  words,    if  the  90  percent  lower  confidence  limit 
of  reliability  is  .  7  and  there  are  200  missiles  available,    the   strategic 
planner  will  count  on  .  7(200)  -  140  missiles. 

When  conducting  an  OT  or  FOT  of  a  missile  system,    a  missile  is 
fired  under  the  most  realistic  conditions  attainable  in  peacetime  and  the 
impact  of  the  missile  on  the  test  range  is  monitored  to  determine  if 
the  missile  firing  obtained  the  desired  results.      Whenever  a  missile  is 
tested,    the  lower  confidence  limit  of  reliability  comes  a  little  closer 
to  the  observed  success  rate.        In  fact,    if  all  the  available  missiles 
were  tested,    then  the  lower  confidence  limit  for  reliability  would  be  the 
observed  success  rate.      A  plot  of  the  90  percent  lower  confidence  limit 
versus  the  number  tested  for  observed  success  rates  of  .  7,    .  8,    and  .  9 
is  shown  in  Figure  3.  1.  1. 

The  crux  of  determining  the  number  of  missiles  to  test  is  depicted 
here.      Obviously,    we  want  the  lower  confidence  limit  of  reliability  to 

The  observed  success  rate  is  merely  the  number  of  successful 
firings  divided  by  the  total  number  of  firings. 
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be  close  to  the  real  reliability  of  the  system.     However,    to  make  the 
lower  confidence  limit  for  system  reliability  the  same  as  true  system 
reliability,    we  must  test  all  the  missiles.      Certainly  this  is  not  the 
solution.      The  problem  of  where  to  stop  testing  could  be  solved  by 
observing  the  graphs  in  Figure  3.  1.  1    and  noting  that  one  is  beyond 
the  "knee"     of  the  curve  if  testing  is  conducted  until  the  lower  confi- 
dence limit  is  within  about  .  1   or  .  09    of  the  observed  success  rate. 
Let  us  investigate  just  what  effect  a  criterion  such  as  this  will 
have  on  a  jlxed  inventory  of  missiles.      In  this  discussion,    the  following 
common  notation  will  be  used: 

M  =  the  total  number  of  missiles  in  inventory; 
n    =  the  size  of  the  test; 

L   -  the  90  percent  lower  confidence  limit  for  reliability. 
This  number  is  determined  by  the  size  of  the  test 
and  the  observed  success  rate. 

Assume  that  M  is  200  and  that  the  observed  success  rate  of  the  missiles 
tested  is  running  in  the  vicinity  of  .  8.      To  satisfy  the  criterion  that  the 
lower  confidence  limit  for  reliability  be  within  .  09  of  the  observed 
success  rate,    i.  e.  ,    .71,    will  require  approximately  50  tests  and  the 
strategic  planner  will  use  (200-50)    .  71   =  106   as  the  expected  number  of 


The  "knee"  of  the  curve  is  a  term  used  commonly  by  some 
economists  and  is  loosely  defined  as  the  point  on  the  curve  where  the 
marginal  increase  in  utility  per  resource  expenditure  is  relatively  low. 
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reliable  missiles.     However,    if,    under  the  same  circumstances  (i.e., 
observed  success  rate  of  .  8)  the  system  was  tested  only  30  times,    the 
lower  confidence  limit  for  reliability  would  be  .  675   and  the  strategic 
planner  could  count  on    .  675(200-30)  =   114  as  the  expected  number  of 
reliable  missiles.      Not  only  is  this  a  gain  in  the  expected  number  of 
reliable  missiles  in  inventory,    but  it  is  also  a  monetary  gain  of  the  cost 
of  testing  20  missiles.      Perhaps  one  more  such  excursion  will  illumi- 
nate more  fully  the  costs  of  the  criterion  outlined  above.      Assume  that 
M  is   150  and  the  observed  success  rate  is  running  about  .  7.      To  satisfy 
the  criterion  that  testing  be  continued  until  the  90  percent  lower  confi- 
dence limit  on  reliability  is  within  .  1  of  the  observed  success  rate, 
i.  e.  ,    a  lower  confidence  limit  of  .  6,    will  require  50  tests  and  the 
strategic  planner  will  count  on  .  6(150-50)  =  60  as  the  expected  number 
of  reliable  missiles.     Under  the  same  circumstances,    if  only  30 
missiles  had  been  tested,    the  lower  confidence  limit  for  reliability 
would  be  .  565    and  the  strategic  planner  would  count  on  .  565(150-30) 
=  68  missiles.      Again  this  is  a  savings  of  eight  more  missiles  in  the 
expected  number  of  reliable  missiles  in  inventory  and  the  cost  of 
testing  20  additional  missiles. 

For  the  reasons  noted  in  the  last  paragraph,    an  alternate  criterion 
for  determining  the  number  of  missiles  to  test  might  be  to  choose  n  to 
maximize  the  quantity  Q  in  the  following  expression. 

Q  =  L(M  -  n) 
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Notice  that  when  n  is  zero,    L  is  zero,    and  therefore  Q  is  zero. 
Whenever  n  is  between  zero  and  M,    Q  is  positive.      Since  Q  is  zero  when 
n  equals  M,    we  know  that  Q  has  a  maximum  value  for  some  values  of 
n  in  the  interval  0  -  M.      In  an  effort  to  show  that  many  complex 
problems  do  not  require  extensive  and  high-powered  mathematics,    the 
value  of  n  that  maximizes  Q  has  been  solved  graphically. 

By  using  semi-log  paper  and  using  values  of   L(M-n)  as  ordinates 
versus  values  of  n  along  the  abscissa,    a  plot  of  the  values  of  Q  for 
various  success  rates  and  values  of  M  can  be  obtained.      This  graph 
is  shown  in  Figure  3.  1.  2.      Plots  of  the  value  of  Q  for  all  combinations 
of  M  =   50,    100,    200,    and  400  and  success  rates  of  .  5,    .6,    .7,    .8,    .9 
are  displayed.      Notice  that  for  values  of  M  greater  than  100  the  value 
of  n  that  universally  maximizes  Q  is  from  33  to  38  missiles.      Thus, 
even  though  the  success  rates  will  be  unknown  prior  to  experimentation, 
it  so  happens  that  the  optimum  sample  size  n  is  basically  a  function  only 
of  M  and  the  confidence  level.      (This  can  be  seen  from  Figure   3.  1.2.) 
Consequently,    the  following  procedure  can  be  implemented.      This 
procedure  is  that  for  M  between  200  and  400  and  success  rates  greater 
than  .  5,    the  test  size  should  be  33.      For  information,    a  table  demon- 
strating the  small  increase  in  the  90  percent  lower  confidence  limit 
for  variations  in  test  size  about  this  "optimal"  number  is   shown  on  the 
following  page. 
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3.  2    Description  of  Missiles  Deployed  Model 

One  problem  with  the  model  presented  in  the  first  section  is  that 
we  can  not  expect  to  use  all  of  the  missiles  in  inventory.      More  than 
likely  the  Polaris   system  will  use  only  the  missiles  that  are  already 
deployed  at  the  outbreak  of  the  exchange. 

An  appealing  model  that  could  be  used  to  determine  the  optimal 
test  size,    considering  only  use  from  deployed  missiles,    can  be  con- 
structed if  it  is  assumed  that  our  defense  resources  have  been  allocated 
in  a  near  optimal  manner.      In  other  words,    money  was  spent  on  the 
Polaris  program  until  the  cost  of  increasing  our  defense  posture 
through  Polaris  was  more  than  the  cost  of  increasing  our  defense 
posture  by  an  equal  amount  using  another  system.      Realize  now  that 
testing  a  system  merely  allows  us  to  count  on  a  larger  number  of  re- 
liable missiles.        The  expected  number  of  reliable  missiles  can  also 
be  increased  by  procuring  a  larger  number  of  systems.      The  cost  of 
increasing  the  expected  number  of  reliable  missiles  through  procure- 
ment is  called  the  marginal  cost  of  reliable  missiles  through  procure- 
ment.     The  marginal  cost  of  increasing  the  expected  number  of   reliable 
missiles  through  testing  can  be  computed  using  the  following  formula. 

Of  course,    if,    on  subsequent  testing,    the  observed  success  rate 
was  lower,    the  expected  number  of  reliable  missiles  used  by  the 
planner  could  conceivably  be  lower  in  this  case.      In  this  exposition,    we 
are  assuming  that  success  rate  is  nearly  constant. 
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MC     =     AL(N)/C 
where: 

MC     =      The  marginal  cost  of  increasing  the  expected 
number  of  reliable  missiles  through  testing. 

AL      =      The  increase  in  the  90  percent  lower  confidence 
limit  for  reliability  caused  by  the  last  test  of  the 
system. 

N         =      The  average  number  of  missiles  deployed  at  any 
time. 

C  =      The  cost  of  testing  the  missile. 

Now  testing  should  be  conducted  until  the  marginal  cost  of  increasing 
the  expected  number  of  reliable  missiles  through  testing  is  equal  to 
the  marginal  cost  of  increasing  the  expected  number  of  reliable  missiles 
through  procurement. 

An  immediate  argument  against  this  model  is  that  to  increase  the 
number  of  reliable  missiles  through  procurement  would  require  a  new 
submarine.      This  is  an  extremely  costly  process  and  would  therefore 
lead  to  excessive  missile  testing  if  the  above  criterion  was  established. 
However,    the  dilemma  can  be  resolved  by  considering  the  marginal 
cost  of  increasing  the  yield  over  the  target  by  any  system  that  com- 
petes with  Polaris.      The  lowest  cost  in  this  group  should  be  used  in 
place  of  the  marginal  cost  for  Polaris.      Thus,    one  could  say  that 
testing  will  stop  whenever  the  cost  of  increasing  the  expected  yield  of 

Yield  is  introduced  here  merely  to  have  a  common  ratio  between 
Polaris  and  the  systems  competing  with  Polaris. 


the  Polaris   system  from  testing  equals  the  cost  of  increasing  the  ex- 
pected yield  of  any  competing  system  through  procurement.      In  this 
case,    MC  would  be  computed  as  follows: 

MC     =     AL(N)(Y)/C 
where  Y  is  the  yield  from  a  Polaris  missile. 

An  explicit  solution  for  n  is  not  included  here  because  the  marginal 
cost  of  procurement  for  Polaris  and  the  systems  competing  with 
Polaris  is  not  known  to  the  author.      However,    these  figures  have  been 
computed;  and  once  they  are  used,    an  explicit  value  for  optimal  n 
follows  immediately. 
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3.  3    Mathematical  Support  of  Model  One 

Consider  a  collection  of  N  missiles  that  are  characterized  by 

lifetimes    X,  ,    X_ X      where  X.   represents  the  time  from  initial 

12  n  i 

inspection  and  release  until  the  i       item  deteriorates  to  an  unacceptable 
state.      If  it  is  assumed  that  the  initial  states  of  the  missiles  are  the 
same,    then  the  X.'s    are  non-negative  independent,    identically  distributed 
random  variables.      Suppose  that  there  are  ten  distinct  times  that  ob- 
servations are  to  be  taken  from  the  collection  of  missiles.      Also, 

assume  that  K    items  are  to  be  observed  at  time  t.  .      These  observa- 
i  i 

tions  can  be  summarized  by  the  random  variables    Y     ,    Y     ,   Y     ,  .  .  .   ,  Y 

1  c         5  K . 

l 

where: 


i     1     if  the  missile  system  fails 

0     if  the  missile  system  is   successful 


On  the  basis  of  this  information,    it  is  desired  to  estimate    R(t),    P 
(a  missile's  lifetime  is  greater  than  t).      The  estimation  procedure 
which  is  proposed  is  of  the  following  form.      For  each  time  t,    the 

estimate  of  R(t)  is  given  by 

n. 
t  i 

n    N  -  n  -      £  Y 

i=l  K=(ni_  i  +   l) 


R(t) 


N(N  -  ni)(N  -  n2)  ...    (N  -  nt-1) 


where: 


n0     =    0 
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where: 


Z    K    ,       i  =  1 ,  2,  ...  ,10 
r=l      r 


K     =     no.    of  trials  in  year  r 
r 

From  this,    it  is  obtained  at  once  that: 


II    [N-n         -K   (1  -p    )] 
i=l 1-i         l  x 

E[R(t)]   =    N(N-n1)(N-n2)...  (N-n^) 

n     [(N-n.       )2-2(N-n.       )  K   (1  -p  ) 
Z              i=l                   i-l                          l-li  l 

E[R(t)     ]    =    — 

[N(N-ni)(N-n2)...  (N-n.^)] 

+  Kipi(l-p.)  +  K.2(l-pi)2] 


[N(N-ni)(N-n2)...  (N-nt^)]2 


and  the  variance  of  the  estimator  is  given  by 

Var     R(t)    =    E[R(t)2]    -    [E[R(t)]]2 
Note  that  Model  One  can  be  defined  as: 

.  r  "f   r         no.    of  failures  in  the  t       test ~] 

L  J   L  N  —  no.    of  missiles  tested  prior  to  time  t  J 

By  considering  numerous  different  possible  results  of  testing,    it  was 

observed  that  this  estimator  tends  to  be  more  conservative  than  the 

Maximum  Likelihood  Estimator  of  reliability  in  the  early  years.      In 

the  out  years,    this  estimator  tends  to  be  pessimistic.      In  addition  to 

the  above  properties,    this  estimate  lends  continuity  to  the  estimates  of 

reliability.      The  excursions  listed  on  the  next  page  illustrate  these  points. 
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Excursion  1 


N  =  100  ,      K.   =   10 ,      for  all  i  .      There  are  two  failures  in  each  test. 

l 


Year 


Model  One  Estimate 


MLE* 


J 
4 
5 

6 
7 
8 
9 
10 


R(t. 
R(t. 
R(t 
R(t^ 

R(t, 
R(t( 
R(t. 

R(t; 
R(t, 


100   -  2 
100 


=     .98(1-—)  =  .956 


956^-80 


932(1-- 


904<1-15o 


:74(1  - 


50 


=     •337(1-40 


79  5(1  - 
741  (1  - 


R(V=    -667(1-- 


=  .932 
=  .  904 
=  .  874 
=  .  837 
=  .79  5 
=  .  741 
=  .  667 
=  .  532 


R(t] 
R(t. 

R(t. 
R(t, 
R(t, 
R(t( 
R(t. 
R(t, 
R(t, 


R(tl0)  = 


10   -  2 
10 


*        Estimate  of  Reliability  using  only  the  yearly  test  information. 
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Excursion  2: 


N  =   100  ,      K.   =   10  ,      for  all  i. 

i 


Year 


LY 


10 
3 


Note  that  the  average  number  of  failures  per  year  is  two. 


Year 


Model  One  Estimate 


MLE  = 


2 
3 
4 
5 
6 
7 
8 
9 
10 


R(t. 
R(t. 
R(t. 
R(t^ 
R(t, 
R(t( 
R(t. 
R(tf 
R(t, 


100   -  3 
100 


.97 


.99     (1   -go)     =    .979 


979  (1    -  go)     =     .954 


.954  (1   -  — )     =     .94 


4     (1-60^    =    ' 


(1-50^    = 


35 


=    .  835 


35(1    -— )     =     .752 


=     .752(1    -_)     =    .713 


R(V  =  •713"-To'  =  -5 


R(t, 

R(t, 
R(t. 
R(t, 
R(t, 

R(t( 
R(t. 
R(t{ 
R(tr 


R(tio) 


.9 
.6 
.8 
1.0 
.  7 
.9 
•  7 


*         Estimate  of  Reliability  using  only  the  yearly  test  information. 
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Excursion  3: 

N  = 

=  200 

Year 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

K 

60 

20 

20 

20 

20 

20 

10 

10 

10 

10 

ZTY. 

9 

3 

4 

3 

2 

5 

0 

3 

4 

4 

Year 


Model  One  Estimate 


MLE* 


R(t. 


R(t. 


R(t 


R(t 


R(t, 


R(t, 


R(t. 


R(t, 


R(t, 


200  -  9 
200 


.955 


955(1    "T40)=     '933 


933  (1   -  — )  =     .897 


897(1    -_>  =     .87 


.87     (1    --)     =     .847 


847(1   -^)     =     .725 


.725 


=     .725  (1    -  — )     =     .652 


.652(1    --)     -     .522 


R(t 


R(t. 


R(t. 


R(t. 


R(t, 


R(t 


R(t, 


R(tc 


R(tr 


=  .85 

=  .85 

=  .8 

=  .85 

=  .9 

=  .75 

=  1.0 

=  .  7 

=  .6 


10 


R(t1Q)=    .652(1--) 


39 


R(t1Q)=      .6 


*         Estimate  of  Reliability  using  only  the  yearly  test  information, 
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GRAPH  OF   e      VERSUS   x 


FIGURE  3.  4.  1 
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3.  4    Mathematical  Support  of  Model  Two 

The  exponential  decay  model  has  been  used  on  numerous  occasions 
to  describe  reliability  decay  of  electronic  systems.     To  this  end, 
Model  Two  introduces  an  exponential  decay.     However,    to  avoid  the 

rapid  decrease  of  reliability  in  the  first  years  that  ensues  using  the 

-  ct 
exponential  decay  form    R(t)  =  p     e  ,    the  following  expression  for 

reliability  is  introduced: 

R(t)  =  pQ   -  BeCt 

where: 

p       =    the  system's  initial  reliability; 

B      -     a  known  constant; 

c       =     an  unknown  parameter; 

t        =    time,      i.  e.  ,    1,  2,   .  .  .  ,  10  . 

ct 
Figure  3.  4.  1   illustrates  that  e       is  greater  than  or  equal  to  one  for 

all  positive  values  of  c  and  t.      Therefore,    if  a  value  of  B  that  is  greater 
than  or  equal  to  one  is  chosen,    negative  values  of  reliability  will  result. 
To  avoid  this,    B  has  been  arbitrarily  set  equal  to  .01.      This  value 
merely  displaces  downward  the  value  of  the  second  term  in  this  ex- 
pression.     With  this  value  of  B,    the  expression  for  reliability  will  be 
positive  for  all  combinations  of  t  from  zero  to  ten  and  c  from  .  00424  to 
.424. 

Because  of  the  invariance  principle,    we  may  obtain  an  estimator 


QQ 


for  c  ,     call  it  c  ;  and  then  the  estimate  for  reliability  can  be  obtained 

by  substituting    c    for    c.      We  will,    therefore,    assume  that  p     is  known 

and  obtain  a  Maximum  Likelihood  Estimator  for  c.      As  a  reminder, 

all  testing  done  in  year  i  is  designated  as  test  i.      Each  individual  firing 

of  a  missile  is  called  a  trial.      K.   is  the  number  of  trials  in  the  i       test, 

1 

and  s.   is  the  number  of  successful  trials  in  test  i. 
1 

The  MLE  is  obtained  in  the  following  manner.      The  probability  that 
s    successes  are  observed  during  the  i        test  can  be  expressed  by: 

K-  s  K.   -   s 

P  [no.    of  successes  =  s]    =     (s  *)    (R(t)  )S    (1    -  R(t)  )     l 

PC      -    s 
=    (?M    (P0   -BeCt)S    (1    -po+BeCt)     * 

Let    L(c)     =     P  [no.    of  successes    =    sj.      Then 


In    L(c)    =    In  (s1)  +  s  In  (pQ   -  Be°    )  +  (K.    -   s)  In  (1    -  p     +  Be      ) 

olnL(c)  -stBeCt  (K.   -  s)  (tBeCt ) 

=    +    1 

dC  r,      Ct  i  r,      Ct 

PQ-Be  1    -p    +Be 


To  obtain  a  Maximum  Likelihood  Estimator  of  c,    set  this  equation  equal 
to  zero.      The  solution  to  this  equation  is  c  .      Doing  this  yields 

c     =    —  In 


t  K.  B 


expanding  in  a  Taylor  series 


100 


.2  .3 


.2  1      1      P0  2       ,       P0     rPi  P^  P^ 

c       =  —    In  —    -   —     In    —         —     + 


2  B2  B      I  p  2  3 

P0  2pQ  3pQ 


...     } 


.2  .3  *  4  .5  .6 

1      fPx  Pi  Upi  1    pi  1      pi  . 

1  Pn  Pn  12Pn  Pn  Pn 


r 
s. 

Now  since    p      =   then    E    p.  =  E|  s.      |  .    Now  s  is  a  binomial 

K.r  L    l     J        K.r       L   '    J 

1  1 

random  variable  with  parameters    p.    and   K.  .      The  method  of  obtaining 
the  expected  values  of  the  powers  of   s    using  factorial  moments  is 
illustrated  in  Appendix  1. 

Using  these  values,    the  mean  and  variance  of  the  estimator  for  c 
may  be  approximated  from  the  following  expressions. 


For  ease  in  writing  these  long  equations,    p.  has  been  used  for 

R(t). 
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=c£i3-T-ta  5  -T-{irFrEcsiJ 


2-1    "^l    J 


2Ki    P0 


3        3 

3Ki  Po 


[.tv...} 


=  In   —     - 


K.  p.    + 


[K,(K,-l)p.     +K.p.] 


t.  B  t.      IK.p.  i  *i         7      2       2    L     ix     i        ,xi  i*i 

i  i  i^O  2K.     pQ 


+    — f-J     [Ki(Ki.l)(Ki-2)p.3 

3Ki    po 


+    3 


(K.  (K.   -   l)p.2   +  K.p.)    -  2  (K.p.)]     +    ...    ]■ 


irr*   2n    •       *  fi    2        °  o    i  °     r_L_       tt  r        i 

E[c.]=—     |ln       -    -    2    In—    |  — -    E[s.] 


2Ki   P0 


i    ^0 


c-i3]] 


ECs,2] 


2       2         L    i 
Ki    P0 


-j-T  E[s.   ]   + 
Ki   po 


11 


E[sf     ] 


12K.    pQ 


4         L   i 


-  E[Si5]  + 


i    *0 


6      6 
9Ki   Po 


[.,']♦...} 
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[«i'j--W- 


2    P0 


i^0 


2Ki  p0 


2-2     [^(K.-Dp.S   K.p.] 


+    5 j-     [K.(K.   -   1)  (K.   -  2)  p.3    +    3[K.(K.  -l)p.2  +  K   p    ] 

3Ki    P0 

-  2K.p.]    +    ...     } 


+  —T-2      (KjIK.-Dp.^K.p.) 

KiP0 


+  — H"   [K.(K.  -  1)  (K.  -  2)  p.3 

Ki    P0 


+     3[K.  (K.   -l)p     +  K.  p.]    -  2K.p.] 


+   l-^-~T    {K    (K    -  1)  (K    -  2)  (K    -  3)p  4 

12Kx    P0 


+     6[K.  (K.    -   1)  (K.   -  2)  p.3   +    3[K.(K.    -  l)p.2|+    K.  p.  ] 


2K.p.     ]      -     11  [K.(K.    -  l)p.      ] 


+    6 


KiPi}    +    ...    } 


.  2 


Var    [c.    ]    =    E[c.    ]    -    E     [  c.  ] 
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3.  5   Mathematical  Support  of  Model  Three 

Models  One  and  Two  involve  fairly  complicated  expressions  for 
R(t).      It  might  be  illuminating  to  compare  these  more  complicated 
models  with  a  simple  linear  model.      Therefore,    the  following  expression 
for  reliability  is  proposed. 


R(t)    =   pQ    -    at 


where: 


p     =  the  initial  reliability  of  the  system; 

a     =  an  unknown  parameter; 

t      =  time,    i.  e.  ,    1,    2,    ...    ,  10  . 
A  Maximum  Likelihood  Estimator  for    a   will,    by  the  invariance 
principle,    result  in  a  Maximum  Likelihood  Estimator  for  reliability. 
The  MLE  of   a    is  found  in  the  following  manner.      The  probability  that 

s    successes  are  observed  in  K.  trials  can  be  expressed  as: 

K     -   s 
P[s.   =   s]     =     (**)    (R(t))S    (1    -  R(t))     * 

K.   -  s 
=    (fi)    (pQ   -  at)S    (1    -  pQ  +  at)     l 

Calling  this  expression  L(a)  and  taking  logs: 

In    L(a)    =    In  (si)    +    s  In  (p      -  at)    +    (K.    -  s)  In  (1    -  p     +  at) 
and 

o  In   L(a)  st  (K.    -  s)  t 

+ 


o  a  pQ  -at         1    -  Pq  +  at 
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Setting  this  expression  equal  to  zero  and  solving  for    a    gives 

K.  p„   -  s  p„ 

1  ^0  ^0  s 

a    : 


and 


K.t  t  K.  t. 

i  li 


E[a]   =    a  Var    [a]    =   l—    (pQ   -  at)    (1    -  pQ  +  at) 

K.t 
l 


follows  directly  from  the  expression  for    a. 
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APPENDIX  I 


FACTORIAL  MOMENTS  OF  A  BINOMIAL  RANDOM  VARIABLE 


The  moments  of  a  binomial  random  variable,    s  ,    may  be  generated 
using  the  probability  generating  function 

Mg(z)   =  (q+  pz) 
where  K  indicates  the  number  of  trials   and 

q   =    1   -  P    • 
For  simplicity  in  notation,    let 


and 


G    =    M    (z) 


t-^  r     K  _   K. 

E[s     ]=  s 


Now 


5G 


z  =  1 


tj-  /  .K  -  1 

=     K(q  +  pz)  p 


z  =    1 


Kp 


o2G 


dz 


K(K  -  1)  (q+  pz)K_2p2 


z  =   1 


K  (K  -   1)  p 


z  =   1 


Since  the  term    (q  +  pz)      will  always  reduce  to  one  when   z    is   set 
equal  to  one,    we  see  a  recursion  relation,    namely: 


n  ^ 
d     G 


5z 


K(K  -  1)  .    .    .    (K  -  (n+  1))  p        . 


z=l 
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We  may  now  deduce  that: 
E  [s(s   -   1)...  (s   -  (n  +   1))]   =    K  (K  -  1)...  (K  -  (n+   1))  pn    . 
Proceeding  from  here,    the  expected  values  are  determined  below. 

E[s(s-l)(s-2)]=    K(K  -  1)  (K  -  2)  p3 

3  2  3 

s      -  3  s      +  2s    =   K  (K  -  1)(K  -  2)p 

_  3  3  2 

;.  s      =  K  (K  -  1)  (K  -  2)p     +  3s      -  2s 


E[s  (s  -  l)(s  -  2)(s  -  3)]  =  K(K  -  1)(K  -  2)(K  -  3)  p4 
s  -6s  +  11  s2  -  6s  =  K  (K  -  1)  (K  -  2)  (K  -  3)  p4 
s       =   K  (K  -  1)  (K  -  2)  (K  -  3)  p4  +  6  s  3  -  11  s      +  6  s 


E[s(s   -  l)(s  -  2)  (s  -  3)(s   -  4)]    =    K(K  -  1)(K  -  2)(K  -  3)(K  -  4)  p 
s5-10s4+35s3-50s2  +  24s    =    K(K-l)(K-2)(K-3)(K-4)p5 
s5    =    K(K  -   1)(K  -  2)(K  -  4)p5  +  10  s4  -  35s  3  +  50s2    -    24s 

E[s(s   -   l)(s  -  2)(s   -  3)(s   -  4)]   =   K(K  -  1)(K  -  2)  (K  -  3)(K  -  4)  (K  -  5)p6 
s      -   15s5   +  85s4  -  225s3  +  274s2  -  120s 

=  K(K  -  1)(K  -  2)(K  -  3)(K  -  4)(K  -  5)  p6 

s6    =    K(K  -   1)  (K  -  2)  (K  -  3)  (K  -  4)  (K  -  5)  p6 

+  15s5  -  85s4  +  225  s       -    274  s       +    120  s 
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APPENDIX  II 
COMPUTER  PROGRAMS 


01  21  66 


DIMENSION  P(10.3),EPni)  f  EPP<  1  1)  tEPSCIl  ) 
0,6) 


C0MM0N/VAR1/AK(  1 
DO  1   J=l,3   r 
GO  TO  ( 18,9,1 10) 
18  AN=200   $  GO  TO 
9  AN=300   $  GO  TO 
1  10  AN  =  U00   $  GO  TO 
101  DO  1  JM=1,3   1 

GO  TO  (2,3,4) ,JM 

2  AL=.01   $  GO  TO 

3  AL=.l    $  GO  TO 

4  AL=.2    $  GO  TO 

5  DO  6  JN=1, 10 

6  P( JN, JM)=EXPF (-A 
CALL  SAMPLE  (A^) 
DO  1  JO=l,6 

DO  8  JP=1  ,10 
M=JP-1 

IF(JP-l)  10,11,1 
11  EP(1 )=( (AN-AM 1, 
EPS(l)  =EP(1)»*2 
SUM  =  0 

EPP(l)  =(AN»*2-2 
1 1,JM) )+(AK( 1, JO) 
SVAR  =EPP( 1 )-EPS 
PRINT  1002,  EP(1 
1002  FORMAT{  10X,  E16 
GO  TO  8 
10  SUM=SUM+AK(M, JO) 
EP(JP)  =  EP(M)*( 
EPS(JP)  =EP(JP)» 
EPP( JP)  =  EPP(M) 
1+AK( JP, JO)»P( JP, 
2(AN-SUM)»*2 
SVAR  =  SVAR  ♦  EPP( 
PRINT  1004,  EP(J 
1004  FORMAT  (10X,E16. 
1) 
8  CONTINUE 

PRINT  1000, AL, AN 
1000  FORMAT  {  10X,9HL 

1  K2  =  ,F4.0,7H 

2  ,FU.0,7H   K7  = 
3.///10X,  19HSUM 

1  CONTINUE 
END 


,J 
101 
101 
101 


11 

1 


L*JN) 


0 
J0)»<1 


P(l, JM) ) )/AN) 


,«AN»AK{ 1,J0)»( l.-P(1,JM))+AK( 1 ,  JO ) «P ( 1 , JM) *{  1 .-P ( 

*(1.-P(1,JM) ) )«*2)/AN*«2 

(1) 

),     EPP(1  )  ,SVAR,AK(1, JO) ,P( 1 , JM) 

.9,10X,    E16.9,     10X,     E16.9,10X,F4.0,10XfE9.8///) 


29f 
30f 

3H 


AN-SUM-AK(  JP,  JO)  •(l.-PUP.JM))  )/(  AN- SUM) 

*2 

«( (  AN-SUM  )••  2-2.  •(  AN-SUM  )•  AK  <  JP ,  JO)  •(!. -PUP  t 

JM)»(1.-PUP,  JM)  )  +  {  AK(  JP,JO)»(  l.-PUP,  JM)  )  )»* 

JP)-  EPS(JP) 

P),  EPP(JP),  SVAR,  AK(JP,JO),SUM,P( JP, JM) 

9,10X,E16.9, 10X,E16.9, 1  OX, F4.0, 5X, F4.0, 1  OX, E9 

,(AK(If JO), 1=1, 10) ,SVAR 

AMBDA  =  ,F4.3,l0X,4HN  =  ,F4.0,///7H   Kl  =  ,F4 

K3  =  ,F4.0,7H  K4  =  ,F4.0,7H  K5  =  .FU.0.7H 
,F4.0,7H  K3  =  ,F4.0,7H  K9  =  ,F4.0t7H  K10  = 
CF  VARIANCES  =  ,E16.9////) 


JM)) 
2)/ 


3< 
351 
35 

37f 

3! 


8/// 


40( 
.0.7H    4' 

K6  =  4; 

,F4.0    4! 
4< 
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01  21  66 


SUBROUTINE  SAMPLE  (AN) 

/VAR1/AK(10,6) 
DO  100  JA=1 ,6 
GO  TO  (1  10,  120,130,140 
DO  111  K=I,10 
AK(K, JA) =.  1*AN 
GO  TO  100 
DC  121  KA=1,5 
AK(KA.JA)=.05*AN 

22  KA=6,10 
AK{KA,JA)=. 15* AN 
GO  TO  100 
DO  131  KB=1,5 
AK[KB,JA)=.  15*A.\I 
DO  132  KB=6,10 
AKtKB,JA)=.05«AN 
GO  TO  100 
AKC 1 ,4) =.3* AN 
DO  141  KC=276 

akikc, ja)  =  .  Wan 

DO  142  KC=7,10 
AK(KC» JA )=.G5*AN 
GO  TO  100 
DC  151  KD=1,4 
AK(KD,JA)=.05*AN 
AKC 5, 5) =.3* AN 
DO  152  KD=o 
AK(KD,JA)=. 1*AN 
GO  TO  100 
AMI  , 6)=.3*AN 
DO  161  KE=3,6 
AK(KE,JA)=. 1«AN 
AK(7,6)=.03*AN 
1  .02*AN 
00  CONTINUE 
RETURN 


111 

120 
121 

122 

30 
31 

32 

40 

41 

42 

50 
51 


52 

60 
61 


1^0,1 60) , JA 


AK  (2,6)  =  .2* AN 


$  AK J  8, 6) =.0  3* AX 


AK(9,6)=.02*AN   $AK(1C,6) 


30 

40 
50 

^0 
70 
SO 

90 
100 

1  1C 
120 
130 
140 
15C 
16C 
170 
180 
19C 
200 
210 
220 

2  30 
240 
250 
2  60 
27C 
280 
r><)0 

3C0 
310 

520 
330 
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0  2    03 


.  N  IT(  12)  ,  LAB  EL (6) 

.  /  •  K  I'li   ,  6  ) 

■ 

:  L  (  1  )  =  U  H    1 

L  {  2  )  =  U  H    2 

_(3)=UH    i 

L(U)=UH    U 

LABEL(5)=^H    5 

LABEL(6)*«4H    c 

'.  N0N  =  1  ,  3 

(2003,2004  ,2005)  ,N  1  . 

C  P  = .  7 

..   2006 

20Cii 

C  P  = .  3 

2006 

2005 

CP  =  .9 

GC  TO  2  0  06 

DO  13  MI  =  1,3 

GO  TO  (7,8,9) , MI 

7 

C,*LL  SAMPLE  (AN) 
GC    TO  400 1 

8 

CALL  SAMPLE (AN) 
GC  TO  4001 

9 

=J  )C 

CALL  SAMPLE (AM) 

gc  to  u; 

DM  112  1=1,12 

l  :: 

ITU  )=8H 
IT(7)=8HP(0)  = 
IT(8)=ICGDE  (CP) 

)=8HN  = 
IT (11)  =  I  CODE  (AN) 
IT( 1 ) =8HSUM  OF  V 
I T(2)=8HARIANCES 
IT  (3)=8H  VS  A 
IT(4)=8H  (DAVE  S 
IT (5)=8HTANF0RC) 
DC  133  J  =  1 , 6 

CALL  PLOTfCP,    Jf.\ON,NCWPLOT,  11 

', LABEL) 

133 

CCNTI  ,M- 
NEWPL0T=10 

13 

CONTINUE 

CONTINUE 

EMC 

110 


LA2E, 


40  i 
2  ] 

. 

7  004 

't  104 
2102 
2101 

102 


- ,  .  -. 0 


+  .1  04  J  . 


COMKGN/VARE  i/AK{  1  •'  Id) 

.(6J  ,PAC(Tj0JrSVAR(1C0)fVAR(10J 
,.),SVAR2IK0,2) 

-1)     110,120,110 
P  A  C  (  1  )    = 
GC    T  . 

)  +  .:  :^2ij 

GC  TC 

:  0  I  P  =  1  ,  1 0 
FIP  =  . 
P(IP)  =  CP-.01*EXPF( FIP*?AC(N) ) 

GC  TC  |02 
CONTINUE 
GC  TO  1 100 

I  N =1,1  " 
- 
IF(N-13  . 
lJ/.C(  1  )  =.0043  8 

PAC(N)  =PAC(K) 

go  rc  11 

.  N  =  1  ,  1  J  C 

IF  (,\-l  )21C2,21C4,;  102 
PAC( 1 )=. 00449 

n 

)=PAC(.V)  +  . 
GC'  TI   ■ 

NUC 
GO  TO  1 i 
DC  141  K  K  =  1  ,  1 .' j 
F  K  K  =  K  !< 

ES  =  AK  (KK,  J}*P  (KK  ) 
ES2=AK(KK,J]  J ) - : 

-   .1  [KK,  J)  *(AK(KK  ,  J)- 
iK(KK, J )* ( AKIKK, J)-l 
+  6.*ES:i  -11.  *ES2  +  6.  *E 
ESS  =  AK  (KK, J  )»(  AK  (KK,  J) 
■   .  )»P{KK)«  ■■■:.    + 
ES6  =  AK (KK, J) *( AKIKK, J) 
)  -4  .  ) * ( AK  {  KK , J ) -5 . J  * P ( K K  )  ** c 
-274.*ES2  +120.»ES 
<  (  K  K  ,  J  )  *  0  P 
CPL  =LCGF(CP/.01  ) 
EC  =  {  1  . /FKK*CPL  -  1.  /rK;{«{  '   ./DEN 

+1./I3.  eDENnM»#2J*£S3)  >**2 
EC2= 1  ./FKK**2*(CPL**2-2.*CPL*( 1  .  /DENCM*ES  +"  . /  I2.*DE 
+  1  ./  I3.*C£.MGM**^)*ES3)  +1  ./  (  CE.MOK**  2  )*E  S2  +  1  ./  (DENCM* 
*Ei>3  +  11  ./I  72.*DcNGM**4)*ES4  + 1 . / { 3.*0EN0M*»5 ) *ES5 


)«P(KK)**2  ^-ES 

.  )*{ AK{KK, J) -2. )»P(KK)«*3  +3 . *ES2-2. *ES 

)*( AK(KK, J)-2. )*(  AK  IKK,  J  )-3.  )  *P{KK)**4  , 

}*(AK  {KK  ,  J) -2.  )*  (AK  (KK, J)-3.  )*( 

.*ES4-  o::.-HS5  +bu.*£S2-24.«ES 

) * ( AK  I KK , J ) -2 . ) * { AK I KK , J ) -3 . ) * ( AK ( KK 

5.*cS5-i5.*_S4+2^5.*ES3 


DENCM**^ ) *ESi 


NG.M 
*3) 


**2i *ES2 


1  11 


03 


3    +    1  . /(<3.*DlNC;-  **6  )*  -S6) 
VAR=EC2-EC 

I  F  (  K  K  -  1)     1  3  !  ,  1  3  5  ,  1  3  1 
=  VAR 

.4  1 

,.'.'.)     +VAR 
i  k  1    C 

ro   ( loc,  noi  ,2ioi    ; .. 

LOT-10  )  I  ,2, 1 

.  DT  =  C 

IRV-  1 

>TS=10C 

J  .7  =  1 
GC    TO    3 
;  DCURV=2 

.  IMPTS=NUMPTS-1 
K0UNT=KCU.NT  +  1 
IF(KCUNT-2 ) 101 , 1C9.101 
}i   '        I   (KOUNT-5) 106, 1C9,] 06 
1 C  9    11  =  11  +  1 

DO    10UI  =  1,1  -jQ 
PAC2(  I,  II  )=PAC( I  ) 
10U    SVAR2  (  I,  II  )  =SVAR  (  I  ) 

GO    TC    200 
1C6    IF     (K0UNT-6)3,5,3 
5    MCDCURV=5 

3    CALL    CRAW(NUMPTS,PAC, SVAR, KODCUR V, 0 , LAB  EL ( KDUNT ) , IT, 0,0, 
1 0, u, 0, 0, 7, 9, 1 , LAST) 
I F (K0UNT-6)20C  ,201  ,200 
20  1    NUMPTS    =100 

CALL    CRAW(NUMPTStPAC2( 1,1 ) ,SVAR2( ] , 1 } , 1 ,C , LABEL ( 2) ,1 T,0, 
10,0,0,0,7,9,1 ,  L  A  S  T  ) 

CALL    DRAK( NUMPTS  , P AC 2 ( 1 , 2 ) ,S VAR2 ( 1 ,2 ) , 3, 0, LABEL ( 5) , I T, C , 
10,0,0,0,7,9,1  ,  L  A  S  T  ) 

200   e::c 


112 


32 


!  T  ] 

/AK(1 

Df  10;   JA=] 

- 

.    i 

A  K  (  K  ,  J  A  )  =  . 

J  !  . 

1  2  _ 

.  ^  . 

' 

J 

_.  2  k  b  =  o , :  - 

152 

,  J  A  )  =  . 

,  1  '  t 

1i- 0 

.  li)=,2»AN 

.-2,6 

141 

C  ? JA)  =  .  i*AN 

. 

1H2 

AX (KC, JA ) =.C5*AN 

1 

1  D  =  1  ,  i 

151 

)=.C5*AM 

AK (5,5)=.3*i 

DO  1  52  KC  =  6  ,  1  rJ 

AK (KDt JA )=. 

GC  m  ]C0 

160 

AK{ i , 6)=.?*AN 

CG  161  :<2  =  3?6 

16  1 

: ,  j  a  )  = .  i 

AK(7r6)  =  .05«/5 

ICO 

UE 

2;.  j 

,6) 


, 1 60), JA 


AK(2:,6)  =  .2*A  . 
AK  {  8  , 6  )  =  . 


a;<(9,6)  = 


*AN       SAK 


n .  a  ^  = 
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02    0. 


NSION    U(  12)  , LAB  EL (6 
C0MM0N/VARE1/AM 10,6 ) 

0  "■■ 


EL<1 )=4H 

1 

L(2) =  4H 

2 

LABEL (3)=4H 

i 

LABEL  (4)=^H 

4 

LABEL(5)=4H 

5 

LABEL(6) =  4H 

6 

00  2001  NO,N  = 

1  ,3 

00  TO  (2  003, 

2004,2005)  ,NON 

2003 

CP  =  .7 

GO  TO  2006 

2004 

CP  =  .  8 

GO  TC  2006 

200  5 

CP  =  .9 

GO  TO  2006 

2006 

00  13  MI=1 ,3 

GO  TC  (7,0,9 

)  ,  M  I 

7 

AN =2 00 

L£  (AN) 

go  to  4  c : n 

8  AM=300 

CALL  SAMPLE  (A.N) 
GO  TO  4 ; 

9  AN=400 

CALL  SAMPLE (AN) 
GO  TO  4001 

4001  DO  112  1=1,12 
112  IT(I)=8H 

IT(7)=8HP(0)  = 
IT(8)=IC0DE  (CP) 
IT(10)=3HN  = 
IT(11)=IC00E  (AN) 
IT( 1 )=8HSUM  OF  V 
IT(2)=8HARIANCES 
IT(3)=8H  VS  A 
IT  (4) =8H  (DAVE  S 
IT(5)=8HTANF0RD) 
DO  133  J=l ,6 
CALL  PLOT(CP, 
133  CONTINUE 

NEW?LOT=10 
13  CONTINUE 

^001  CONTINUE 
END 


Jv  :,..::  v  'viL  .  rJT  v  IT  v^A:  EL  } 
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'.'  <* 


02  J  2 


1 . 0  0( 


1  10 

;  12 


U0 
130 

1002 


1  104 

1  1C2 

1106 


niu 

1112 

mo 

1101 
1004 


210' 

2106 


2 11 14 
2112 


SUBR 

dim: 

GO  T 
DO  1 
M  =  N- 

PACI 
PACJ 

FNO= 
VAR{ 
I  F  ( N 
SVAR 
SVAR 
CO  NT 
CONT 
GO  T 

- 
IF(N 

PAC( 
PAC( 
DC;  1 
FNO  = 
V  A  R  ( 
IF(N 
SVAR 
SVAR 

CON! 
GO  T 

DO  2 
M=N- 

: 

FNO  = 

SVAR 
SVAR 
CONT 

CONT 

I F  ( .\ 

I  I  =0 

GO  T 
MODC 
NUMP 


g^E^^l  J.NON.NEHPLOT.IT.LABEI.J 

04)  . 


I  002 
1  =  1,100 

- 1 )  110,120,110 

i )=.ooo7   .    ro  102 
;   i- .  o  o(  7 

10=1  ,10 

N0)  =  1 . /(AKfNO, J)  *FN0**2) 

-  )130,140,130 
(N)=VAR( 1 )    $   GO  TC  Al 
( N)=SVAR(N)+VAR( NO) 
INUC 
INUE 

.00 
101  N=l,100 

-1)     1102,1104,1102 

1 )=.000S         I    GC    TO 

N)=PAC (M) +.00    3 

110      NO    =    1,  1C 

NO 

N0)  =  1./  (AK (NO, J] 

0-1 )     1112,1114,' 

J    1113 
(N)=SVAR{ N)+VAR(NO) 
INUE 
I 

a     '. : : 

i  0 1    N    - 
1 

-1)21  210-      "       _ 

i  )  = .  ]    I  D 

.  +  .  )009 
-    =1,10 

10,  J)     *FNO**?.  )*< 
0-       I       2,2114,21 12 
(N)=VAR( 1  GO    TO    21  1C 


?-PAC(.M)*F,\0)*{ 


P+?AC(N)*FNC 


) a (CP-PAC(N)*FN0)«(1 .-CP+PAC(N)«FNC 


?-PAC(N)*FNO)*( 1 .-CP+PAC(N)*FNO 


(N)  =SVAi 

INUl 
0    1  1  0( 

LOT  =  ^ 


+    VAR(NO) 


0)1,2,1 


URV=  : 

TS=100 

T  =  l 

C    5 

U  R  V  =  2 

TS  =  NUMPTS- 
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02 


. 


IF  (KG 

;C1 

I  F  (  K  0 

■09 

I  I  —I  I 

PAC2( 

^0U 

SVAR2 

106 

IF  (K 

5 

MGOCU 

. 

. 

0,0,0 

IF(KO 

201 

.  '  ,/-; 

CALL 

0,0,0 

Call 

0,0,0 

200 

END 

IT  +  1 
UNT-2) 10  1,1 09, 1 01 
-  )  106 f 109 f 106 
+  1 

41=1,1 

MI)  =PAC(  I  ) 
(I , I  I )=SVAR(I ) 

-653, 5, 3 

.JTS  ,PAC  ,SVAR,MODCURV,0, LABEL(KOUNT)  ,  IT,  0,  0, 
,0,7,9,1 ,LAST) 

IN    -6)200,201,200 
S    =100 

DRAW(NUMPTS ,PAC2( 1,  1 ) ,5VAR2(1 ,1  ),1,0,LABEL(2),IT,0,0, 
,0,7,9,1 ,LAST) 

DRAW(NUr/:PTS,PAC2{  1,2)  ,SVAR2(  1,2),3,0,LABEL(5),IT,0,j, 
,0,7,9,1 ,LAST) 
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\2    02 


i  n 

. : . 

122 


I  3U 

1  3 1 

132 

141 

li>2 
160 
161 

100 


on   i  o 

GO  TC 
DO  1  1 
AKCK, 
GO  TO 
DO  12 

AK  (KA 

GO    TO 

DO    1  3 

AK  (KC 

AMKC 

GO    TO 

AK(KD 
DO    lb 

; 

GO     i  0 

a;<(  l , 
::o    l  6 

AK  (KC 

.02*  A 

RETUR 
END 


/AK( 1C,6) 

20,1 30,1 U0,1  50,1  60),  J  A 


.     (AN) 

RE  ' 

0  JA=1 

1  K  =  l, 
JA)  = 

. 

1  KA=1,5 

■  J       - 

6 ,  1  0 

- ;  5  -  a:m 

1 :  j 

J     )  =  .  i  5  *  A  .\ 

2  KB=6, 10 
,  JA)  =  .05*AN 

U)  =  . 

1     K  C = 2 , 6 

,  JA)- 

£    KC  =  7 

,  ,     )  =.  05*A,N 

,  J  A  )=.(  5*  AN 
5  )  =  .  : 

=  6  T 1  0 

"i     KE=3,6 
, JA  )=.  1*AM 
6)=.03*AN 


AM2,6)  =  .2*AN 
AK  {  3,6  )  =  .03*Ai 


AKC9,6)=.02*AN       s,AK(10,6)  = 


IUE 
N 
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13.  ABSTRACT 

The  first  section  of  this  paper  is  concerned  with  determining  the  required 
lower  confidence  limit  that  must  be  met  by  testing  after  a  missile  system 
becomes  operational.      Some  of  the  costs  of  making  decisions  about  the  re- 
quired system  reliability  lower  confidence  limit  are  discussed.      Two  possible 
cost  effective  models  for  determining  the  optimum  test  size  are  suggested. 

The  second  section  of  this  paper  is  concerned  with  the  effects  of  changing 
the  number  of  missiles  tested  in  each  year  while  maintaining  the  total  number 
of  systems  tests  constant  over  the  missile  system's  projected  operating  life. 
In  other  words,    in  this  section,    the  effects  of  testing  heavily  in  the  first 
years  versus  testing  heavily  at  the  end  of  the  system's  life  or  versus  testing 
uniformly  throughout  the  life  of  the  system  are  compared.      For  this  com- 
parison,   the  sum  of  the  variances  of  the  estimators  determined  from  the 
results  of  the  tests  conducted  in  each  year  is  obtained.      This  value  is  com- 
pared for  six  representative  distributions  of  testing  throughout  an  estimated 
system  life  of  ten  years. 
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